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Abstract 

Fitting a Candecomp/Parafac (CP) decomposition (also known as Canonical Polyadic decom- 
position) to a multi-way array or higher-order tensor, is equivalent to finding a best low-rank 
' approximation to the multi-way array or higher-order tensor, where the rank is defined as the 

' outer-product rank. However, such a best low-rank approximation may not exist due to the 



fact that the set of multi-way arrays with rank at most R is not closed for i? > 2. Nonexistence 
' of a best low-rank approximation results in (groups of) diverging rank-1 components when an 

• attempt is made to compute the approximation. In this note, we show that in a group of two 

or three diverging components, the components converge to proportionality almost everywhere. 
A partial proof of this result for larger groups of diverging components is also given. Also, we 
give examples of groups of three, four, and six non-proportional diverging components. These 
examples are shown to be exceptional cases. 
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1 Introduction 



This note is an addendum to Stegeman [7j where the following subject is studied. Let o denote the 
outer-product, and define the rank (over the real field) of y G ]^^^-^^^ as 

R 

rank(3^) = min{i? [ 3^ = o o c^} . (1-1) 

r=l 

Let 

Sr{I, J, K) = {yG M^x-^x^ I rank(3^) < R} , (1.2) 

be the set of I x J x K arrays with at most rank R, and let Sji{I, J, K) denote the closure of 
Sji{I, J,K), i.e. the union of the set itself and its boundary points in M^x>^x_fs:_ 

Let Z G i^^x-'x^'' and || • || denote the Frobenius norm on M.^^"^^^. Consider the following 
low-rank approximation problem. 

mm{\\Z-y\\\y eSRiI,J,K)}. (1.3) 

The variables in this problem are actually the rank-1 terms in the rank-i? decomposition of y: 

R 

y = Ur (a^ o br o Cr) , (1-4) 

r=l 

where vectors a^., b^., c^. have norm 1, r = 1, . . . ,R. The decomposition (|1.4p is known as Cande- 
comp/Parafac (CP) or Canonical Polyadic decomposition. Let A = [ai[ . . . [a/?], B = [bi| . . . |b/j] 
and C = [ci I . . . \cji]. 

Assuming rank(2) > R, an optimal solution of ()1.3p will be a boundary point of the set 
Sr{I, J, K). However, the set Sr{I, J, K) is not closed for R > 2, and problem (jl.Sp may not 
have an optimal solution due to this fact; see De Silva and Lim [2j. This results in (groups of) 
diverging rank-1 terms (also known as diverging CP components) in ()1.4p when an attempt is made 
to compute a best rank-i? approximation, see Krijnen, Dijkstra and Stegeman [3]. In such a case, 
the solution array y converges to a boundary point X of Sji{I, J, K) with rank(>^) > R. In practice 
this has the following consequences: while running a CP algorithm to solve (|1.3p . the decrease of 
11-2 — 3^11 becomes very slow, and some (groups of) columns of A, B, and C become nearly linearly 
dependent, while the corresponding weights uj^ become large in magnitude. However, the sum of 
the corresponding rank-1 terms remains small and contributes to a better CP fit. More formally, a 
group of diverging CP components corresponds to an index set C {1, . . . , R\ such that 

|4")|^oo, for all rG I?, (1.5) 

while II (4"^ ° b(") o 4")) II is bounded , (1.6) 
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where the superscript (n) denotes the n-th CP update of the iterative CP algorithm. More than 
one group of diverging components may exist. In that case p.5p - (|1.6|) hold for the corresponding 
disjoint index sets. 

In practice, a group of diverging components as described above is almost always such that the 
corresponding columns of A, B, and C become nearly identical up to sign. That is, the diverging 
components are nearly proportional. In this note, we focus on the question whether this is always 
true or not. In Section 2, we show that in a group of two or three diverging components, the 
corresponding columns of A, B, and C converge to rank-1 almost everywhere. In Section 4, we 
give a partial proof of this result for larger groups of diverging components. In Sections 3, 5, 
and 6, we give examples of groups of three, four, and six non-proportional diverging components, 
respectively. These examples are shown to be exceptional cases. 

In this note, all arrays, matrices, vectors, and scalars are real-valued. 

2 Groups of two or three diverging components 

We need the following notation. A matrix form of the CP decomposition (|1.4|) is 

Yfc = ACfcB^, k = l,...,K, (2.1) 

where Y^, is the k-th I x J frontal slice of y, and is the diagonal matrix with row A; of C as its 
diagonal. In ()2.ip . the weights ujr are absorbed into A, B, and C. 

We use y = (S, T, U)-^ to denote the multilinear matrix multiplication of an array Q € K^^^^Q 
with matrices S {I x R), T (J x P), and U (K x Q). The result of the multiplication is an / x J x 
array 3^ with entries 

R P Q 

r=l p=l q=l 

where Sir, tjp, and Ukq are entries of S, T, and U, respectively. We refer to multiplication (I/, Ij, U) • 
Q with U nonsingular as a slicemix of Q. We say that Q has a nonsingular slicemix if / = J and 
the array (I/,I/,U) • Q has a nonsingular frontal I x I slice for some nonsingular U. 
For later use, we state the following lemma. 

Lemma 2.1 For R < min(/, J, K) and y G 'Sr{I, J, K), it holds that y = (S, T, U) /or some S, 
T, U column-wise orthonormal, and some Q € Sr{R,R,R) with all frontal slices upper triangular. 
Moreover, y € Sr{I, J, K) if and only if G & Sr(R, R, R) . 

Proof. See Stegeman [71 Lemma 2.2 (b)]. □ 
Our main result is the following. 
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Theorem 2.2 Let = (A^, B^, C^, fiW) be an I x J x K CF decomposition, i.e. 



R 



(2.3) 



r=l 



with A("\ B("\ and C^") having the length-1 vectors ab^\ hl~^\ and Cr""* as columns, respectively, 
and fi*^") = diag(a;j;"'\ . . . , wj^''). Let 3^^"^ — > ^ with rank(<^) > R, and such that \ujr 
each r. 



oo for 



(i) If R = 2, then A^^\ B*^"^, and C^") converge to rank-1 matrices, 
(ii) If R = 3, then A^'^\ B*^"^, and C^"^ converge to rank-1 matrices for almost all X. 

Proof. Krijnen et al. [4] show that A^"), B^"), and C^") converge to rank-deficient matrices. 
For R = 2, this completes the proof. Next, let ii = 3 and suppose min(/, J, ivT) > 3. We have 
X € 83(1 , J, K) and A' is a boundary point of 83(1, J, K). By Lemma 12. H there exist L, M, 
N with orthonormal columns such that X = (L, M, N) • Q, where the 3x3x3 array G has all 
frontal slices upper triangular. We have rank(Cy) = rank(A') > 3 and the rank-3 CP sequence 
(L^,M^,N^) • ^ g. Slightly abusing notation, we write = (A^"), B^"), C^")) ^ Q, 
where the weights w^"^ have been absorbed in A^"), B^"), C*^"\ which are now 3x3 matrices. 

We assume that Q has a nonsingular slicemix. This is true for almost all X, i.e., the subset of 
boundary points X with rank larger than 3, for which G does not have a nonsingular slicemix, has 
lower dimensionality than the set of boundary points with rank larger than 3. In fact, if Q does 
not have a nonsingular slicemix, then its upper triangular slices have a zero on their diagonals in 
the same position. 

We apply a slicemix to Q such that its first slice is nonsingular. Next, we premultiply the slices 
of g by the inverse of its first slice. Then Q is of the form 



Q = [Gi I G2 I G3 



1 








a 
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a 
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u 





1 
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e 





/? 


e 








1 








c 








7 _ 



(2.4) 



Since a matrix cannot be approximated arbitrarily well by a matrix of lower rank, it follows that 
the approximating rank-3 sequence J^^*") has a nonsingular slicemix for n large enough. Moreover, 
by Lemma |2. II we may assume without loss of generality that y^"'^ has the form (j2.4p . We denote 
the entries of y^"'^ with subscript n, i.e. On, ■ ■ ■ , fn and a„, . . . ,Vn- Hence, 





1 








On 


dn 


fn 


y{n) ^ jy[") I Y^"^ [ Y^"^] = 





1 








K 


Cn 










1 








Cn 



an 





^n ^n 
f^n £n 
7n 



(2.5) 
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Next, we consider the rank-3 decomposition (A("\ B("\ C^")) of y^"'\ which can be written as 
C^"^ (B^"))-^, where diagonal matrix C^"^ has row k of C^"^ as its diagonal, k = 1,2, 3. 



Since Yj" = I3, matrices A^") and B^") are nonsingular. Without loss of generality, we set 
C["^ = I3. Then (A("))-i = (B("))^ and y["^ = A(") (A("))-i for k = 2,3. Hence, slices Y^"^ 



(n) 

and Y3 have the same eigenvectors. Moreover, their three eigenvectors are linearly independent, 
lei 

eigenvalues cin ^bn,Cn and an-, fin-, In, respectively, we obtain 



and their eigenvalues are on the diagonals of Cg"^ and Cg"^ , respectively. Since Yg"'* and Yg""* have 



1 1 1 

O'n bn Cn 
an Pn In 



(2.6) 



From Krijnen et al. j3] we know that A("), B("), and C(") converge to matrices with ranks less than 
3. The eigendecomposition Y^"^ = A*-"-* (A*-"-*)"^ converges to frontal slice of ^, k = 2,3. 
Hence, the eigenvectors in A^") converge to those of G^, A; = 2, 3. Suppose A^") has a rank-1 limit. 
Then Gfc has only one eigenvector and three identical eigenvalues, k = 2,3. Hence, a = b = c and 
a = /3 = 7. Suppose A^") has a rank-2 limit [ai a2 a^], with ai,a2,a3 eigenvectors associated with 
eigenvalues a,b,c of G2, and eigenvalues a, (3,^ of G3, respectively. Without loss of generality, let 
ai and a2 be linearly independent. If a3 is proportional to either ai or a2, then B^") = (A^"))"^ 

(n) 

has large numbers in only two columns. This violates the assumption of \ujr | — )• 00 for r = 1,2, 3. 
Hence, a3 is in the linear span of {ai,a2} and not proportional to ai or to a2. For an eigenvalue A 
of Gfc, we define the eigenspace 



Ek{X) = {x G 



Gfcx = Ax} 



A; = 2,3. 



(2.7) 



It holds that Ai 7^ A2 implies -Efc(Ai) fl £"^(-^2) = {0}. If a,b,c are distinct, then ai,a2,a3 would 
be linearly independent, which is not the case. Without loss of generality, let a = b. Then 
^3 £ E2{a) n E2{c), which is impossible if a 7^ c. Hence, it follows that a = h = c. The proof of 
a = /? = 7 is analogous. This implies that C*^") in (j2.6p converges to a rank-1 matrix. 

As 3^(") ^ g, we first assume that the eigenvalues an,bn,Cn are distinct and the eigenval- 
ues an,Pmln are distinct. It can be verified that the eigenvectors A^") of Y^'^ associated with 
eigenvalues an,bn,Cn are, respectively. 



1 



\ 



. {Cn-an){c„.—bn) . 

+ fn(Cn-bn) / 



(2.8) 





As explained above, the eigenvectors of Yg"^ 

(n) 

Y2 . We assume d 7^ 0, e 7^ 0, / 7^ 0, 5 7^ 0, e 7^ 0, 7^ 0, which holds for almost all X. Combined 



'in terms of ar, 



must be identical to those of 
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with a = b 
A(") as in 



c and a = /? = 7, it follows from ()2.8p that A^") converges to a rank-1 matrix. For 



the columns of B^"^ 
1 \ 



(an-bn) 
+ fnian-b„) I 

\ {an-b„){a„-Cn) / 



(AW)- 

/ 



T 



are 







{b„—a„) 

dn 6n 

{a„-bn){Cn-bn) / 



V dnC'ji-\- fn{Cn bn) . 
{c„~an){c„—b„) / 



(2.9) 



Hence, each column of B"^^^ contains large numbers for large n. After normalizing the third entries 
of each column of B^^^ to 1, we obtain 



1 



{bn 







(2.10) 



It follows that also B*^"^ converges to a rank-1 matrix. 

Above, we assumed distinct eigenvalues o„,5„,c„ and a^j/^niTn- Next, we show that cases 
with identical eigenvalues can be left out of consideration. We only consider cases where some of 
(in,bn,Cn are identical. Cases where some of q,/3,7 are identical can be treated analogously. If 
o-n = bn 7^ Cn for n large enough, then we must have = to obtain three linearly independent 
eigenvectors of . This is due to the upper triangular form of in (|2.5p . This implies that 
d = in the limit, which does not hold for almost all X. 

The case (in ^ b^ = Cn can be dealt with analogously. Here, we must have e„ = to obtain 
three linearly independent eigenvectors of Yj"^ in (|2.5p . This implies that e = in the limit, which 
does not hold for almost all X. 

Next, suppose CLji — Cn 7^ bn for n large enough. To obtain three linearly independent eigenvec- 



tors of in (|2.5p . we must have dnCn + fn{cn — bn) = 0. Since c„ 



c — 6 = 0, this implies 



that de = in the limit, which does not hold for almost all X. 

Finally, we consider the case (in = bn = Cn for n large enough. To obtain three linearly 
independent eigenvectors of in (j2.5p . we must have dn = &n = fn = 0. This implies that 
(i = e = / = Oin the limit, which does not hold for almost all X. This completes the proof for 
min(/, J, K) > 3. 

Next, let min(/, J, K) = 2. Without loss of generality, we assume I > J > K . If I = J = K = 2, 
then ^isa2x2x2 array, which has maximal rank 3 [3j. A contradiction to rank(A') > 3. If 
I > J = K = 2, then by [2, Theorem 5.2] there exists a column- wise orthonormal L (/ x 3) such 
that X = (L, 12,12) • G, with Cy a 3 x 2 x 2 array and rank(^) = rank{Q). Since the maximal rank 
of 3 X 2 X 2 arrays is 3 [3], we again obtain a contradiction. 

Finally, let / > J > A' = 2. By [2, Theorem 5.2] there exist column-wise orthonormal L (/ x 3) 
and M ( J X 3) such that X = (L, M, I2) • G, with Cy a 3 x 3 x 2 array and rank(;f ) = rank(Cy) > 3. 
The remainder of the proof is analogous to the beginning of the proof for min(/, J, K) > 3. We 
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let = (A("),B("),CW) ^ g, where and are 3x3, and C(") is 2 x 3. As shown 
in [U], array G can be transformed to have upper triangular slices. Assuming G has a nonsingular 
slicemix, we transform it to 



^ = [Gi I G2] 



a d f 
b e 
0c 



(2.11) 



(2.12) 



1 
1 
1 

We assume 3^*^"^ to be of the same form, with entries an,bn,Cn,dn,en, fn- As above, we have 

■"ill 

Q-n bn Cfi 

and eigendecomposition Y^'^ = A^"^ C^2^^ (A^"))^^ converging to frontal slice G2- Krijnen et al. 
[1] show that C^") converges to a rank-deficient matrix. Hence, C*-"-* converges to a rank-1 matrix, 
and we have a = 6 = c in the limit. 

We assume distinct eigenvalues CLnjbn,Cn- As above, having some identical eigenvalues for n 
large enough yields d = or e = or / = 0, which does not hold for almost all X. The eigenvectors 
A^"-) of Y2"^ are given by ()2.8p . We assume 7^ 0, e / 0, / 7^ 0. Since a = 6 = c, it can be seen 
that A^") converges to a rank-1 matrix. The same is true for B^") = (A^"))"^, which has columns 
equal to (|2.10p after normalizing the third entry of each column to 1. This completes the proof. □ 



3 Example of non-proportional diverging components for R = 3 



X 



(3.1) 



The example is of size 3x3x2. Let 

'"100 
1 
1 

with e 7^ and / 7^ 0. Here, X plays the role of Q in ()2.1ip . Since d = in ^ above, this is an 
exception to almost all boundary arrays X with rank(A:') > 3. We have = ( A(") , B(") , C^")) ^ 
X , with 



a / 
a e 
0a 



1 
1 




1 

€n (Cn ) 
fn (Cn hn ) 
{Cn-an) 
fn 



1 



fn 






fn 



(an—Cn) (bn—Cn) (Cn—Cln) 



(3.2) 



and C*^"^ as in ()2.12p . Let Un = a + 1/n, bn = a — 1/n, Cn = a + 2/n. Then 

1 1 



aW 



1 — 

u i 3^ 





b(") 







1 1 1 



(3.3) 
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where the columns of B^") are normahzed such that their third entries are equal to 1. As we see, 
converges to a rank-2 matrix. Note that l^r"^! — > oo for r = 1,2,3 in this example, since all 
three columns of B^") in ()3.2p will have large numbers as entries. 

4 Extension to groups of four or more diverging components 

Can statement (ii) of Theorem 12.21 also be proven for i? > 4 if the requirement R < min(/, J, K) 
is added? A proof of this could be analogous to the proof for R = 3 under this requirement. That 
is, we have 3^^"^ = (A'^"'\ B*^"), C^")) — > G, where Q is R x R x R and has its first slice equal to 
1r and its other slices upper triangular. Matrices A^"), B^"), and C*^") have size R x R, with 
B(n) ^ (aW)-^, C^"^ = Ir, and y["^ = A(") (A("))-i converging to frontal slice of G, 
k = 2, . . . ,R. Suppose we have shown that G^, k = 2, . . . ,R, all have R identical eigenvalues. 
Then the limit of C^") analogous to (j2.6p is a rank-1 matrix. For any fixed i? > 4, we can use 
symbolic computation software to obtain expressions for A*^""-* and B*^""-* analogous to ()2.8p - ()2.10p . 
This would imply that also A^") and B^"'^ when normalized to have length-1 columns, converge 

(n) 

to rank-1 matrices. The cases where has some identical eigenvalues for n large enough, 

2 < k < R, restrict some entries of Q to zero. This is an exception to almost all boundary arrays 
X with rank(A') > R. 

The difficulty in obtaining the proof sketched above seems to be in showing that G^, k = 
2, . . . ,R, all have R identical eigenvalues. For this to be proven, the possibilities for the rank and 
dependence structure of the limit of A^") must be analyzed. To have a group of R diverging com- 
ponents with > 4, it must not only be checked that all columns of B*-"-* = (A'^"-')"^ contain large 
numbers, but also that the R components do not consist of several different groups of diverging 
components. For example, if i? = 4, then having two groups of two diverging components corre- 
sponds to two times two identical eigenvalues in the limit. In this case, the limit of A*-"-* has two 
groups of two proportional columns. 

To demonstrate the above, consider the case i? = 4. It suffices to show that G2 has four identical 
eigenvalues. Let G2 have eigenvalues Ai,A2,A3,A4 and associated eigenvectors A = [ai sl2 a.3 a.4], 
with A(") A. Let E{X) = {x e M'' : G2X = Ax} denote the eigenspace corresponding to 
eigenvalue A. We have rank(A) < 4. If rank(A) = 1, then G2 has only one eigenvector and four 
identical eigenvalues: Ai = A2 = A3 = A4. 

Next, let rank(A) = 2. Without loss of generality, we assume a3,a4 € span{ai,a2}, with 
ai and a2 linearly independent. Suppose Ai = A2. Then a4 e E^X^) n -E'(Ai), which implies 
Ai = A4. Analogously, a.3 E i^'(A3) n -E'(Ai) implies Ai = A3. Hence, we obtain Ai = A2 = A3 = A4. 
Next, suppose Ai 7^ A2. Because rank(A) = 2, we have at most two distinct eigenvalues. If 
A3 = Ai 7^ A2 = A4, then ai and a3 are proportional and a2 and a4 are proportional. Hence, 
this is a case of two groups of two diverging components, and not one group of four diverging 
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components. If Ai 7^ A2 = A3 = A4, then a2,a3,a4 are proportional, and we have a group of three 
diverging components only (i.e., large numbers in three columns of B*^") = (A^"))"^ only). Other 
possibilities for Ai 7^ A2 and rank(A) = 2 are analogous. It follows that if rank(A) = 2, then 
Ai = A2 = A3 = A4. 

Next, let rank(A) = 3. Without loss of generality, we assume a4 G spanjai, a2, a3}, with 
ai,a2,a3 linearly independent. Suppose Ai = A2 = A3. Then a4 G -E(A4) n£'(Ai), which implies 
Ai = A4, and yields the desired result. Next, suppose Ai = A2 / A3. If A4 = Ai, then we have a 
group of three diverging components only. If A4 = A3, then and a4 are proportional, and we 
have a group of two diverging components only. If A4 ^ Ai and A4 7^ A3, then rank(A) = 4 which 
is not possible. Next, suppose that Ai, A2, A3 are distinct. Then A4 must be equal to one of them. 
Let A4 = Ai. Then ai and a4 are proportional, and we have a group of two diverging components 
only. Other possibilities for the equality of some eigenvalues can be treated analogously. It follows 
that if rank(A) = 3, then Ai = A2 = A3 = A4. 

As a final remark, we state that under the requirement R < min(/, J), the case K = 2 can be 
proven for any i? > 4 analogous to the proof oiI>J>K = 2 and i? = 3. 



5 Example of non-proportional diverging components for R = A 



This example is in the spirit of ^ Section 4]. Let min(/, J) > 6, > 5, and i? = 4. Let A = [ai a2] 
(/ X 2) and B = [bi b2] (J x 2) be random matrices. For random Q (2 x 2), let A = [ai £12] = AQ 
and B = [bi 62] = BQ"^. Then AB^ = AB"^, which implies 



ai o bi o c + a2 o b2 o c — ai o bi o c — a2 o b2 o c = O , 

for any vector c, where O denotes an allzero array. Let X = [xi ... X4] (/ x 4) and Y = [yi 
(J X 4) and Z = [zi ... Z4] [K x 4) be random matrices. 
We define 



bW = 



1 


1 


1 


1 


ai + - xi 


a2 + - X2 


-ai X3 


-a2 X4 


n 


n 


n 


n 



bi + -yi 

n 



1 



n 



Zl 



1 

b2 + - y2 

n 

1 

C + - Z2 

n 



bi + - ys 

n 

1 

c + - Z3 

n 



b2 + - y4 

n 



1 



c H — Z4 

n 



(5.1) 

• y4] 

(5.2) 
(5.3) 
(5.4) 



If we let = n (A("), B("), C(")) X, then by using ([51]) we obtain 

X = ai o bi o Zl + ai o o c + xi o bi o c + a2 o b2 o Z2 + a2 o y2 o c + X2 o b2 o c 

— ai o bi o Z3 — ai o y3 o c — X3 o bi o c — a2 o b2 o Z4 — a2 o y4 o C — X4 o b2 o c . (5.5) 

The mode-1 rank of X equals rank[A | A | X] = 6. The mode-2 rank of X equals rank[B | B [ Y] = 6. 
The mode-3 rank of X equals rank[c | Z] = 5. Since rank(A') is at least equal to its mode-i rank. 
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i = 1, 2, 3, it follows that rank(^) > 6. As we see, both A^") and B^") converge to rank-2 matrices, 
while C^") converges to a rank-1 matrix. 

We create X according to (|5.5p and compute the 4x4x4 array Q with upper triangular slices 
in the transformation X = (L, M, N) • Q, using the Jacobi-type SGSD algorithm of [1] modified as 
described in [5j. Recall that existence of this transformation follows from Lemma l2.ll Next, we 
transform the slices of G such that its first slice becomes I4. We observe the following form for 
slices 2,3,4 of the transformed Q: 

a e g 
a c f 
a 
a 

Hence, the slices have four identical eigenvalues and zeros in positions (1,2) and (3,4). The latter 
property shows that the limit point is an exception to almost all boundary arrays X with rank(A') > 
4. 



(5.6) 



6 Example of non-proportional diverging components for R = 6 

This example is similar to the one in Section 5. Let min(I, J, K) > 8 and R = 6. Let 

(6.1) 
(6.2) 

11-1 J L^-*-"^] [oiu 

Then we have 

^ ^ _ 10 

7 o o Cr = 7 a.r o o Cr = , (6.3) 

f^i ^ [o ij 

where the latter is a rank-2 array. Let S (/ x 2), T (J x 2), and U (K x 2) be random matrices. 

Let X (/ X 6), Y (J X 6), and Z {K x 6) be random matrices. We define 

A(") = [SA| - SA] + ix - diag(l, 1, 1, -1, -1, -1) , 
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= [TBITBI + i Y, 
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C(") = [UC[UCl + - 
n 



(6.4) 
(6.5) 



Since the CP decompositions (SA, TB,UC) and (SA,TB,UC) yield the same I x J x K array, 
it follows that 3^(") = n (A("), B("), C^")) ^ X, with 
3 

X = ^^(Sa^ o Tbr o Zj. + Sa,. o y,. o UCr + Xr o Tbr o UCr) 



r=l 



^(Sa^ o Tb^ o Zs+3 + SsLs o ° Uc^ + o Tb^ o Uc^ 



(6.6) 
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The mode-1 rank of X equals rank[SA | SA | X] =8. The mode-2 rank of X equals rank[TB | TB | Y] = 
8. The mode-3 rank of X equals rank[UC | UC | Z] = 8. Since rank(A') is at least equal to its mode- 
i rank, i = 1,2, 3, it follows that vank^X) > 8. As we see, matrices A*^"\ B*^"-*, and C^"^ all converge 
to rank-2 matrices. 

We create X according to ()6.6p and compute the 6x6x6 array Q with upper triangular slices 
in the transformation X = (L,M, N) • G, using the Jacobi-type SGSD algorithm of [1] modified as 
described in [S]. The resulting slices of Q have entries (4,4) and (5,5) almost zero. Hence, Q does 
not seem to have a nonsingular slicemix. This implies that the limit point is an exception to almost 
all boundary arrays X with rank(A:') > 6. 
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